Embedding Interactive Objects into a Video Session

ABSTRACT

A method includes receiving, at a media device, overlay data associated with media content. The overlay data includes information indicating a time and a position at which a particular object is represented within the media content, and the overlay data includes information associating the particular object with supplemental information. The method further includes, during playback of the media content, receiving user input at the media device, and, responsive to the user input, generating an overlay display based on the overlay data, where the overlay display causes the particular object to be highlighted in a display of the media content.

FIELD OF THE DISCLOSURE

The present disclosure is generally related to embedding interactiveobjects into a video session.

BACKGROUND

Digital advertising spending continues to grow. Examples of digitaladvertising include interactive advertising via a television platform.Traditional broadcasting technologies tend to use static televisionadvertising programs (e.g., “commercials”) which do not benefit from allof the advantages offered by digital advertising technologies. Forexample, television programs often include static one-way advertisingcontent that does not allow viewer interaction. Relative to interactiveviewing, one way viewing experiences may have less impact on the viewersand lead to fewer sales or other transaction events.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a particular example of a system to display anoverlay associated with media content;

FIG. 2 illustrates another particular example of a system to display anoverlay associated with media content;

FIG. 3 illustrates a particular example of overlay data within anoverlay file;

FIG. 4 illustrates another particular example of overlay data within anoverlay file;

FIG. 5 illustrates a method of displaying an overlay associated withmedia content; and

FIG. 6 illustrates a block diagram of a computer system to display anoverlay associated with media content.

DETAILED DESCRIPTION

Embodiments disclosed herein offer a method to highlight selectedobjects within a program (e.g., a television program) to allow viewersto participate interactively with the program. In particular, objectsrepresented within an existing program (e.g., a program that has notbeen specifically edited to provide interactive content) may beassociated with supplemental content. The supplemental content mayinclude overlay data that specifies locations of objects within theexisting program and provides information about highlighting the objectson a display. Creating and embedding dynamic selectable objects into aprogram provides an enhanced viewing experience for consumers. Inparticular examples, the overlay data may be received by a media deviceafter playback of the program has begun at the media device. Further,the overlay data may be received by a plurality of media devices, eachreceiving the program in a different display format. For example, eachof the plurality of media devices may receive the program in a differentresolution, and the overlay data may include overlay information for theprogram in each resolution. Receiving common overlay data duringplayback may enable greater flexibility in distribution of the overlaydata. For example, a single instance of the overlay data may be storedat a server and may be distributed in response to requests.

Embedded objects may be associated with actions or additionalinformation (e.g., alternative or additional streams of informationassociated with the object or the program). For example, an embeddedobject may be used to provide an e-commerce capability (e.g., byindicating that a viewer may order a product that he or she has seenduring the program). As another example, an embedded object may enableinteractive television commercials. To illustrate, during a televisioncommercial that is otherwise static, a viewer may select an image orrepresentation of a product. In an illustrative example, a system (e.g.a computing device) can redirect the viewer to an online order page orcan facilitate the completion of an order associated with the product.Alternatively, or in addition, the viewer can select to be provided withadditional information. The system may access the additional information(e.g., a web page or other e-commerce link associated with the product)and display the additional information on a television viewed by theviewer.

FIG. 1 illustrates a particular embodiment of a system 100 configured todisplay an overlay associated with media content. The system 100includes a headend 110, such as a cable television headend, an internetprotocol television (IPTV) headend, a satellite television headend, orother media distribution headend. The headend 110 may be associated withone or more media devices, represented by media device 120. Inalternative examples, the functions described as performed by theheadend 110 may be performed by a server on a public network, such as aserver that is connected to the Internet and that distributes videocontent. Although only one media device 120 is illustrated in FIG. 1,the headend 110 may be coupled to more than one media device. In aparticular example, the media device 120 includes a set-top box device.In other examples, the media device 120 may include any device thatexecutes media player software, such as a personal computer, a mobilephone, a tablet computing device, etc.

In one example, one or more media devices may be associated withsubscribers in a geographic region, such as a city, or a portion of acity.

The media device 120 may be coupled to one or more display devices 130,such as televisions. Each display device 130 may be adapted to display arepresentation 132 of media content based on user interaction requestingparticular media content. In a particular embodiment, the media contenthas not been adapted specifically for purposes of providing dynamicinteractive capabilities. The headend 110 may communicate with the mediadevice 120 via a content distribution system 108 and one or more accessnetworks 115. The access network 115 may include a satellitedistribution network, a cable television network, an Internet protocolnetwork, or another wired or wireless communication network that enablesthe media device 120 to access media content via the headend 110.

During use, a user associated with the media device 120 may use a remotecontrol device 122 to provide a control signal 126 to the media device120. The control signal 126 may be transmitted via a wired connection orwirelessly (e.g., via an infrared or radio frequency signal). Thecontrol signal 126 may indicate selection of particular media content154, such as via an electronic program guide (EPG) or a channel changerequest. In response to the control signal 126, the media device 120 maytransmit a media request 152 to the headend 110. In response to themedia request 152, the headend 110 may acquire data associated with theparticular media content 154 requested by the media request 152. Forexample, the media content 154 may include a television program, a livebroadcast, video on demand content, pay per view content, or other mediacontent accessible via the headend 110. In a particular exampleillustrated in FIG. 1, the headend 110 includes a media database 114from which the media content 154 may be accessed by a server 118.However, in other embodiments, the headend 110 may access the mediacontent 154 from a media content provider (not shown).

In response to the media request 152 identifying the media content 154,the headend 110 may transmit the media content 154 to the media device120.

Additionally, the headend 110 may provide overlay data 156 to the mediadevice 120. The overlay data 156 may be accessed by the headend 110 atan overlay data base 116 included at the headend 110 or received from aremote provider such as an interactive content provider (not shown). Forexample, in response to the media request 152, the headend 110 mayaccess a metadata database 112. The metadata database 112 may containinformation about the particular media content 154, such as informationidentifying whether an overlay file associated with the particular mediacontent 154 is accessible in the overlay database 116 (or via the remoteprovider). When the overlay file is indicated to be present in theoverlay database 116, the server 118 may access the overlay database 116and provide the overlay file as the overlay data 156 to the media device120. In a particular embodiment, the overlay data 156 may be provided tothe media device 120 after the media device 120 transmits the mediarequest 152, after the headend 110 transmits the media content 154, or afirst portion of the media content 154, to the media device 120, orduring playback of the media content 154 at the media device 120. Forexample, the overlay data 156 may be provided to the media device 120 inresponse to a request from the media device 120 for the overlay data156. The overlay data 156 may be provided to the media device 120 aspart of a media stream corresponding to the media content 154 or via aseparate data stream or side channel.

In particular examples, the overlay data 156 is generated automatically(e.g., the overlay data 156 may be generated using an image recognitionsystem to automatically identify objects in the media content 154).Alternatively, the overlay data 156 may be generated by a user (e.g., auser associated with the headend 110 or a user associated with anoverlay provider (not shown)). For example, the user may correspond to acontent provider, an advertiser, or a developer hired to generateoverlays. The user may use software to view the media content 154 and togenerate (e.g., draw) bounding boxes (e.g., a box that, when overlaid onmedia content, contains a particular object) and create descriptiveinformation. The software may store information describing the boundingboxes and descriptive information in the overlay data 156. For example,the information describing the bounding boxes may include coordinatepoints relative to one or more screen resolutions. The overlay data 156can be a relatively small file including information such as a timestamp (e.g., an indication of a time, relative to a beginning of a mediastream, that an object first appears in the media stream or a portionthereof), coordinate locations of a bounding box 134, an objectdescriptor associated with an object 133, and information (e.g., anaction identifier) indicating a particular action to be taken orselectable menus to be displayed in response to selection of the object133 or display of the bounding box 134. Accordingly, a flat file can beused to provide the overlay data 156 such that the overlay data 156consumes little bandwidth relative to the media content 154.

The media device 120 may begin playback of the media content 154 bygenerating the representation 132 at the display device 130. During theplayback of the media content 154, the media device 120 may also examinethe overlay data 156 to determine when an object is represented in therepresentation 132 that is associated with the overlay data 156. Forexample, the overlay data 156 may include a plurality of entriesassociated with the representation 132. In a particular example, theoverlay data 156 may include an entry for each object that ishighlightable within the representation 132. The media content 154 mayinclude more than one highlightable object. An example of media contentincluding multiple highlightable objects is shown in FIG. 2, and anexample of an overlay file describing multiple highlightable objects isshown in FIG. 3. In some examples, the overlay data 156 may includemultiple entries for a particular object at different times. Forexample, the object 133 may appear and may be highlightable in the mediacontent 154 at a plurality of different times, and the overlay data 156may include an entry for each time period the object 133 ishighlightable in the media content 154. Each entry may include a timestamp, or a time stamp range, and position data associated with theobject. For example, in the embodiment illustrated in FIG. 1, theoverlay data 156 may include a time stamp, or a time stamp range, andposition data describing when and where the bounding box 134 that isassociated with the object 133 is located in the representation 132 ofthe media content 154.

Additionally, the overlay data 156 may include an indication that thebounding box 134 and the associated object 133 are associated withinteractive content at the time indicated by the time stamp and theposition indicated by the position data. Further, the overlay data 156may include one or more action identifiers associated with one or moreobjects (or bounding boxes defining the objects). Each action identifiermay correspond to an action related to an object (e.g., retrieveadditional information about the object using a particular uniformresource locator, place a phone call (e.g., via a voice over internetprotocol (VoIP) server) to a particular vendor of the object, place anorder for the particular object, etc.).

In particular examples, the media content 154 may correspond to aparticular program in a first display format (e.g., a first resolutionand/or a first frame rate). The overlay data 156 may include overlayinformation corresponding to a plurality of versions of the particularprogram. Each version of the program may have a different displayformat. For example, one version of the program may have a first displayresolution and/or frame rate and another version of the program may havea second display resolution and/or frame rate. The overlay data 156 mayinclude entries for each highlightable object in each version of theprogram. Thus, the same overlay data 156 may be sent to a media devicethat receives the particular program in the first display format and toa media device that receives the particular program in a second format.

FIG. 1 also includes an example of overlay information 135. The overlayinformation 135 is represented separate from the representation 132 toillustrate components of the overlay information 135. The overlayinformation 135 may be determined based on the overlay data 156. Theoverlay information 135 may represent non-visible components of overlaydata used to determine or identify a location of the selectable object133 in the representation 132. In particular, the overlay information135 may define the bounding box 134 associated with the object 133. Thebounding box 134 may define a region of the representation 132 that isto be highlighted in response to user input to enable selection ofsupplemental content associated with the object 133, as describedfurther with reference to FIG. 2.

In the example shown in FIG. 1, the bounding box 134 is defined by fourvertices, each corresponding to a pixel of the representation 132. Forexample, the vertices may include vertex A, vertex B, vertex C, andvertex D. The vertices may correspond to xy coordinate pixel positionsdefining a rectangular bounding box. The xy coordinate pixel positionsmay be relative to a two-dimensional coordinate system having maximumvalues described by maximum horizontal and vertical pixel resolutioncounts in a particular format. In other embodiments, other mechanisms todefine the bounding box may be used. For example, the bounding box 134may be defined based on a starting vertex such as vertex A, and apredefined size or indication of a selection of a predefined size (e.g.,assuming that each side of the rectangle is parallel to one of thex-axis and the y-axis of a display and perpendicular to the other axis,the starting vertex may identify a particular vertex, such as the topleft vertex, and the size may define dimensions of the rectangle). Inanother example, the bounding box 134 may be defined by a pair ofnon-adjacent vertices (e.g., A and C or B and D). For example, giventhat A=(X1,Y1) and C=(X2,Y2), the two remaining vertices may bedetermined (e.g., by the media device 120) to be located at (X1, Y2) and(X2, Y1) based on the properties of rectangles. In other embodiments,the bounding box may be a non-rectangular polygon and may be defined bymore (e.g., the bounding box may be a pentagonal, hexagonal, heptagonal,octagonal, etc.) or less than four vertices (i.e., the bounding box maybe triangular). In some embodiments, the bounding “box” may not be apolygon (e.g., the bounding “box” may include one or more curved sides).

During playback of the media content 154 by the media device 120, theoverlay information 135 may be hidden. In response to user inputindicating an interest in a particular object, the overlay information135 may be used to generate the bounding box 134 on the representation132 (i.e., highlight the object 133 by drawing the bounding box 134).Additionally, object information or menus 138 may be provided to enableselection of particular information or content. For example, the objectinformation or menus 138 may be displayed in response to a selection ofthe object 133 once the object 133 is highlighted.

In a particular example, the remote control device 122 may include athree axis sensor 124. The three axis sensor 124 may detect movement ofthe remote control device 122 by the user. In response to movement ofthe remote control device 122 by the user during playback of the mediacontent 154 at the display device 130, the media device 120 maydetermine that the user is interacting with the media content 154.Accordingly, the media device 120 may present the bounding box 134indicating that the object 133 is selectable. Alternatively, the mediadevice 120 may control a pointing device, as shown in FIG. 2, inresponse to movement of the remote control device 122. When the pointingdevice hovers at a particular location, such as within the bounding box134, for a threshold period of time the media device 120 may display thebounding box 134 to highlight the object 133 to indicate that the objectis selectable.

Thus, the media device 120 may receive user input during playback of themedia content 154 (e.g., movement of the remote control device 122during playback of the media content 154 indicating the user device isinteracting with media content or hovering within a bounding box) and,responsive to the user input, the media device 120 may generate anoverlay display based on the overlay data 156. The overlay display maycause the object 133 to be highlighted in the representation 132 of themedia content 154 to enable selection of supplemental content.Highlighting the object in response to user input may allow a user todetermine which objects are selectable without pausing playback of mediacontent.

Upon receiving a selection of the highlighted object 133 (e.g.,detecting a “click” within the bounding box 134 or detecting that thepointer remains within the bounding box 134 for a threshold period oftime), the media device 120 may display the object information and/ormenus 138. In a particular example, the media device 120 pauses playbackof the media content 154 when displaying the object information and/ormenus 138. When the media device 120 receives a selection of the object133 within the bounding box 134 or a selection of a particular optionfrom the object information or menus 138, the media device 120 may sendan information request 158 to the headend 110. For example, theinformation request 158 may include information identifying the boundingbox 134 or the particular option from the object information or menus138 selected by the user.

The information request 158 may include an action identifier associatedwith one or both of the object 133 and a particular option from theobject information or menus 138. The action identifier may have beenreceived with the overlay data 156, as described above, and maycorrespond to action information stored at the overlay database 116. Theheadend 110 may identify and perform the corresponding action. Forexample, the corresponding action may include requesting additionalinformation, enabling voice communications between the media device 120and another device, initiating a commercial transaction, or any otheraction. The headend 110 may perform the action internally or may send arequest 162 to a remote source, such as an e-commerce site 140. In otherexamples, the remote source may include non-commercial sources, such asinformational web pages or call centers. The request 162 may be sent viaa public network 160 or via a private communication network. Thee-commerce site 140 includes one or more servers 142 and an objectcatalogue 144. The request 162 may include an identifier of the object133 which may correspond to an identifier in the object catalogue 144.The request may further indicate an action, such as purchase, initiatevoice communications, obtain additional information, or any otheraction. In response to the request 162, the e-commerce site 140 mayprovide supplemental content 164 (e.g., an order confirmation, aninformational web page, a voice or video connection, any othersupplemental content, or a combination thereof) associated with theobject 133 to the headend 110 or directly to the media device 120 viathe network 160.

In response to receiving the supplemental content 164, the headend 110may provide additional information, such as display information 166, tothe media device 120. The display information 166 may instruct the mediadevice 120 how to display the supplemental content, such as in a pop-upwindow (e.g., in a window that overlays the representation 132), via aseparate channel, and so forth. In examples where the supplementalcontent 164 includes a voice or video connection, the displayinformation 166 may instruct the media device 120 to display connectionidentification information (e.g., caller ID information).

In a particular embodiment, the media device 120 may include an objectoverlay setting. The object overlay setting may indicate whether theuser associated with the media device 120 elects to enable interactiveinformation associated with media associated with media presented by themedia device 120. For example, the overlay setting may be disabled andin response the media device 120 may not send the information request158 or may not receive the overlay data 156. Thus, interactive contentmay be disabled at the media device 120 and the display device 130.Alternately, the overlay setting may be enabled such that the mediadevice 120 operates to provide supplemental content responsive to userinput.

In a particular embodiment the media device 120 may include a processthat executes an overlay application. The overlay application maygenerate an overlay display based on the overlay data 156. The overlaydisplay may include the bounding box 134. Additionally, the overlayapplication may match a time stamp, or a time stamp range, associatedwith the media content to a time stamp, or a time stamp range,associated with the overlay data 156 in order to determine which objectsare associated with supplemental content or bounding boxes at aparticular time during playback of the media content 154. For example,during playback of the media content 154, the media device 120 may checkthe overlay data 156 periodically (e.g., every second) for one or moreentries having time periods corresponding to the current playback timeof the media content 154.

In another embodiment, the overlay application is executed in responseto user input such as pointer or control input indicating that the useris requesting information associated with a particular object in therepresentation 132. For example, in embodiments where the remote controldevice 122 is used to direct a pointer in the representation 132 to aparticular position, the overlay application may be executed when thepointer hovers at a particular location for a threshold period of time.The overlay application may check one or more time stamps associatedwith the overlay data 156 to determine objects within the representation132 that are selectable. The overlay application may display an overlaydisplay, including the bounding box 134 in the example of FIG. 1,indicating selectable objects. In addition, the overlay application maygenerate (e.g., in response to a selection of the object 133) otherselectable options associated with the object 133 such as the objectinformation and/or menus 138.

During presentation of the bounding box 134, the object informationand/or menus 138, or both, the overlay application may cause playback ofthe media content 154 to be paused. If the media content 154 is receivedas a stream (e.g., as a stream of data packets from the headend 110),the media device 120 may record the media content 154 to a memory of themedia device 120 (for subsequent playback after interaction associatedwith the object 133 is complete). Thus, the system 100 may provide amechanism for associating the supplemental content 164 with the object133 represented in media content 154. Further, the media content 154does not need to be modified to enable interaction associated with theparticular object 133. Therefore, data need not be added to the mediacontent 154 and transmitted to user devices that do not support or havenot requested interactive content.

In a particular embodiment, the object information and/or menus 138 mayinclude options associated with social network interactions.Alternatively, certain social network interaction icons may beautomatically displayed without receiving prior user input. In oneexample, the object information and/or menus 138 may include an iconassociated with a “like” interaction. A selection of the “like” icon maycause execution of an application on an application server (e.g., theserver 118). For example, the media device 120 may send the informationrequest 158 including an action identifier of the “like” icon. Theserver 118 may receive (e.g., as part of the information request 158)social network subscription information from the media device 120 andmay send a request to a server 192 of a social network 190. The server192 may update a profile of a user associated with the media device 120based on the request (e.g., indicate that the user “likes” the mediacontent 154).

As another example, the object information and/or menus 138 may includea “share” icon. A selection of the “share” icon may cause theapplication server to upload particular content to the social network190. For example, when a user “shares” a movie (e.g., the media content154) that he or she is watching, a trailer for the movie may be uploadedto the social network 190 and shared with “friends” or “followers” ofthe user. Alternately, or in addition, the media device 120 may send theapplication server elapsed time information that indicates how far intoa movie or television program the user selected the “share” icon. Theapplication server may use the elapsed time information to generate a“clip” of the movie or television program to upload to the socialnetwork 190. For example, the “clip” may be automatically generated bycropping a particular amount of time before and/or after the elapsedtime (e.g., from 10 seconds before the elapsed time to 10 seconds afterthe elapsed time). Thus, the present system and method may enablesubscribers to share “interesting” moments of a movie or program andencourage other viewers (e.g., social network “friends” or “followers”)to view that movie or program (or the identified clip).

Additional interactions may also be performed or enabled. For example,an automatic social networking update may be sent to the social network190 based on the media content 154 (e.g., “I am watching [movie title]on channel [number]”). The social network 190 may also include a link toa trailer, advertisement, and/or on-demand listing for the media content154. As another example, the object information and/or menus 138 mayinclude a “more information” icon that, when selected, cause the server118 to retrieve information regarding the media content 154 from athird-party source (e.g., an online encyclopedia).

FIG. 2 illustrates a system 200 to display an overlay over mediacontent. The system 200 includes a media device 210 and a display 215.In a particular embodiment, the media device 210 may correspond to orinclude the media device 120 of FIG. 1. The display 215 may correspondto or include the display device 130.

In the illustrated embodiment, the display 215 displays a representation232 of media content and overlay information corresponding to the mediacontent. The overlay information is represented by a first bounding box234, a second bounding box 252, and a plurality of object informationoptions 238. The object information options 238 may include an objectinformation option 244, a purchase option 242, a more information option240, other options not shown, or any combination thereof. Therepresentation 232 includes a first object 231 associated with the firstbounding box 234 and a second object 250 associated with the secondbounding box 252.

In the example illustrated in FIG. 2, the first bounding box 234 ishighlighted indicating that the first object 231 is selectable based onthe presence of a pointer 230 within a region corresponding to thebounding box 234. The plurality of object information options 238 may bedisplayed in response to a selection of the first object 231. The secondobject 250 may also be selectable but may not be highlighted while thepointer 230 is located outside of the second bounding box 252.

In FIG. 2, the media device 210 includes a processor 212 and a memory214 accessible to the processor 212. The memory 214 includesinstructions 222 that are executable by the processor 212 to performactions associated with the media device 210, such as sendinginformation requests, receiving media content, generating arepresentation of media content, generating an overlay display,receiving overlay data, receiving display information, and so forth. Themedia device 210 may also be associated with one or more interfaces suchas a display interface 220 that is configured to be coupled to a displaydevice, such as the display 215 or the display device 130 of FIG. 1, inorder to display media content and/or additional information, such assupplemental content and overlay displays. The media device 210 alsoincludes one or more network interfaces 216 to provide access tocommunications from the headend 110 of FIG. 1 or other network devicesor systems, such as the e-commerce site 140 of FIG. 1. The networkinterfaces 216 may include wired or wireless interfaces to enablecommunication via a cable television network, a satellite data link, viaa cellular data link, via DSL, or via a fiber link.

The media device 210 may also include a remote control interface 218(e.g., a wireless sensor). The remote control interface 218 may enableinteraction with a remote control device, such as the remote controldevice 122 of FIG. 1. For example, the remote control device 122 mayprovide control signals 126 to the media device 120 via a remote controlinterface such as the remote control interface 218.

In a particular embodiment, the memory 214 includes an overlay file 224.The overlay file 224 may include overlay data associated with aparticular media content item. For example, the overlay file 224 maycorrespond to a particular program or a particular video on demand mediacontent item accessed by the media device 210. In a particularembodiment, the overlay file 224 stores overlay data such as the overlaydata 156 of FIG. 1. The memory 214 may also include media data 226. Themedia data 226 may correspond to media content such as the media content154 received from the network headend 110. The media data 226 may alsocorrespond to media content received from other sources such as personalmedia content associated with a user or recorded media content that ispreviously recorded and is not streamed from a headend. The overlay file224 may correspond to the media data 226. For example, one or moreprograms stored in the memory 214 as the media data 226 may have acorresponding overlay file 224 that provides information to generate anoverlay display associated with the particular media content item.

The memory 214 may include multiple programs, and each program isassociated with interactive content. The overlay files 224 may includemultiple files, each file corresponding to a particular program or mediacontent item. For example, when the media device 210 is a digital videorecorder that stores media content in the memory for later playback, thememory 214 may also store corresponding overlay files associated withthe media content stored at the digital video recorder to enable adisplay of overlay data when the stored media content is played back.

During operation, the media device 210 may receive an overlay file(e.g., the overlay file 224) as overlay data associated with particularmedia content (e.g., media content included in the media data 226). Theoverlay data may include information indicating a time and position atwhich a particular object such as the first object 231 is represented inthe media content. The overlay data may also include informationassociating the first object 231 with supplemental information, such asinformation accessed by selection of the more information option 240. Inparticular examples, the overlay data includes information associatedwith objects for a plurality of time periods. For example, the overlaydata may include information describing a plurality of time periodsduring which the first object 231 appears in the media content. Inparticular examples, the overlay file 224 may include informationindicating overlay data for a plurality of versions of the media content(e.g., a plurality of display resolutions and/or frame rates of themedia content). For example, the first object 231 may appear atdifferent times and/or locations in a first version of the media contentas compared to a second version of the media content.

During playback of the media content, the media device 210 may receiveuser input (e.g., via the remote control interface 218). The user inputmay correspond to movement of a movement sensitive remote control device(e.g., the remote control device 122) indicated via a signal received atthe remote control interface 218. For example, the user input mayinclude a point of control input that controls the pointer 230. Themedia device 210 may determine a position within the representation 232of the pointer 230 based on the pointer control input. Responsive to theuser input, the media device 210 may generate the overlay display basedon the overlay data. For example, the media device 210 may cause thefirst object 231 to be highlighted via the bounding box 234 in responseto user input indicating selection of the first object 231 (e.g., thepointer 230 being located within the first bounding box 234 for aparticular period of time). In a particular embodiment, the media device210 does not cause overlay information for an object to be displayedunless the object is selected. For example, while the first object 231is selected, the first bounding box 234 may be highlighted, but thesecond bounding box 252 associated with the second object 250 may not bedisplayed.

When the first bounding box 234 is highlighted, the media device 210 mayreceive a further selection of the object 231 (e.g., detect a “click”within the bounding box 234 or determine that the pointer 230 stayswithin the bounding box 234 for a threshold period of time) and displayadditional information 238 in response to the further selection. In theillustrated embodiment, the additional information 238 includes objectinformation 244. The object information 244 may include a description ofthe first object 231. The additional information 238 further includes amore information option 240 to display additional information about thefirst object 231 and a selectable option 242 to conduct a transactionrelated to the object 231.

Thus, the system 200 may display an overlay over media content. Theoverlay may be invisible until a selectable object is selected and maytherefore be unobtrusive. Further, the overlay may be generated withoutaltering associated media content.

FIGS. 3 and 4 illustrate particular embodiments of overlay data withinan overlay file. For example, the overlay files represented in FIGS. 3and 4 may correspond to the overlay file 224 of FIG. 2 or the overlaydata 156 of FIG. 1 or both.

Overlay file 300 of FIG. 3 includes information associated with a firstmedia content item. An overlay file may include a plurality of entrieseach associated with a time stamp indicating when a particular object isrepresented within the media content item. For example, the overlay file300 includes a first entry 301 with a time stamp 302. Each entry of theoverlay file may also be associated with a duration indicating how long(e.g., in seconds) the object is represented in the display. Forexample, the first entry 301 includes a duration 304. Entries of theoverlay file may also include information indicating coordinates of abounding box, which describe where a media device (e.g., the mediadevice 120 or the media device 210) should draw the bounding boxassociated with the particular object. In the illustrated example, thefirst entry 301 includes coordinates 306.

As illustrated, in the overlay file 300, the coordinates 306 may includecoordinate pairs associated with vertices of a bounding box (e.g., thebounding box 134, the first bounding box 234, or the second bounding box252). In other examples, the coordinates may be represented in otherways, such as with a coordinate of a particular vertex and a defaultsize selection or by other mechanisms. Each entry of the overlay file300 may also include an object identifier indicating a name or otheridentifier associated with the object associated with the bounding box.For example, the first entry 301 includes an object identifier 308 thatidentifies a “HandiPhone” object. In some examples, an entry of anoverlay file such as the first entry 301 may further include an objectdescriptor (not shown) that describes an object. Further, the entries ofan overlay file may include supplemental information associated with anobject such as a communication address associated with an advertiser orother supplemental information. For example, the first entry 301includes supplemental information 310 identifying a website associatedwith the object identified by the object identifier 308.

In a particular embodiment, the media content item may be formatted fordisplay at different types of display devices. For example, differentdisplay devices may have a different pixel count or a different aspectratio. Accordingly, the overlay file may include entries associated witheach object for multiple display formats, including pixel count, aspectratio and so forth. Thus, the overlay file 300 includes a first set ofentries associated with a display format of 1920 pixels by 1080 pixels.Additionally, the overlay file 300 includes a second set of entriesassociated with a display format including 1280 pixels by 720 pixels.The overlay file 300 may include more than or fewer than the two displayformats indicated. For example, the display overlay file 300 may includeentries associated with each envisioned display format including highdefinition standard definition, three-dimensional, ultra-highdefinition, 4 k, as well as multiple aspect ratios. Each version of themedia content may have different associated playback times (e.g., due todifferences in frame rates) and a particular object may be located atdifferent coordinates in each version. Accordingly, the overlay file 300may include a plurality of entries for a particular object, where eachentry of the plurality identifies a time and a location that theparticular object appears in the version corresponding to the entry. Inthe illustrated example, the overlay file 300 includes a third entry 330corresponding to the first entry 301 at a different resolution(1280×720) than the first entry 301 (1920×1080).

FIG. 4 illustrates another particular embodiment of an overlay file 400.The overlay file 400 may correspond to the overlay file 224 of FIG. 2 orthe overlay data 156 of FIG. 1 or both.

The overlay file 400 includes a time stamp 402 and a duration 404. Thetime stamp 402 and the duration 404 may function as described inreference to the time stamp 302 and the duration 304. The overlay file400 further includes coordinate information 406 associated with aparticular object or objects in a display. In the illustrated example,the coordinate information may define two vertices, such as twonon-adjacent vertices. A media device (e.g., the media device 120 or themedia device 210) may calculate the remaining vertices based on thecoordinate information 406 and properties of rectangles (e.g., arectangle has four right angles). The overlay file 400 also includes anobject ID 408. The object ID 408 may identify a particular object (e.g.,the object 133, the first object 231, or the second object 250)represented in media content.

The overlay file 400 further includes a first action ID 410 and a firstaction description 412. The first action ID 410 may identify a firstaction to be performed that is related to the particular objectidentified by the object ID 408. The overlay file further includes asecond action ID 414. The second action ID 414 may identify a secondaction to be performed that is related to the particular objectidentified by the object ID 408. The overlay file 400 further includes afirst action description 412 and a second action description 416 thatdescribe the first action and the second action, respectively.

Upon receiving user input during playback of media content, a mediadevice (e.g., the media device 120 or the media device 210) may outputan overlay. The overlay may include highlighting of one or more objectsbased on entries in the overlay file 400. Upon receiving a selection ofa particular object at a particular time during playback of the mediacontent, the media device may display a menu that includes optionscorresponding to actions described in an entry that corresponds to theparticular object and the particular time. For example, upon receivinguser input (e.g., movement of a remote control device during playback orhovering within a bounding box defined by the coordinate information406) the media device may cause the bounding box defined by thecoordinate information 406 to be displayed. Upon detecting a selectionof the object associated with the bounding box (e.g., detecting a clickwithin the bounding box) the media device may display a menu with a menuoption for each of the action descriptions 412 and 416.

In response to receiving a selection of a menu option corresponding tothe first action description 412, the media device may send the objectID 408 and the first action ID 410 to an external server to perform thefirst action, as explained above. Similarly, in response to receiving aselection of a menu option corresponding to the second actiondescription 416, the media device may send the object ID 408 and thesecond action ID 414 to the external server to perform the secondaction, as explained above.

Thus, the overlay files 300 and 400 may enable an overlay to begenerated for a media content item without altering the media contentitem. The overlay files 300 and 400 may further enable actions to beperformed that are related to the media content item. In addition, theoverlay files 300 and 400 may be sent to a plurality of media devicesthat may receive the media content item in different formats. Further,the overlay files 300 and 400 may be sent to a media device after themedia device has begun playback of the related media content item.

FIG. 5 shows a flowchart illustrating a method 500 of generating anoverlay for media content. The method 500 includes receiving overlaydata associated with media content, where the overlay data includesinformation indicating a time and a position at which a particularobject is represented within the media content and the overlay dataincludes information associating the particular object with thesupplemental information, at 502. The overlay data may be received in anoverlay file during playback of the media content. For example, themedia device 120 may receive the overlay data 156 from the headend 110during playback of the media content 154. The overlay data 156 may beassociated with the media content 154. The overlay data 156 may indicatea time and a position in the representation 232 of the media content 154that the object 133 is shown. Similarly, the media device 210 mayreceive and store the overlay file 224 in the memory 214. The overlayfile 224 may be associated with the media data 226. The overlay file 224may indicate a time and position that the first object 231 and thesecond object 250 appear in the representation 232 of the media data226. The content of overlay files is further explained above withreference to FIGS. 3 and 4.

The method 500 further includes, during playback of the media content,receiving user input (e.g., a pointer control input) at the mediadevice, at 504. For example, the media device 120 may receive thecontrol signal 126 from the remote control device 122 while outputtingthe representation 132 of the media content 154. Further, the mediadevice 210 may receive input via the remote control interface 218 whileoutputting the representation 232 of the media data 226.

The method further includes determining a position in the display of auser pointer based on the pointer control input, where the particularobject is highlighted when the user pointer is determined to be within abounding box defined by the overlay data, where the bounding box isspecified in the overlay data. For example, the media device 120 mayposition of a pointer in the representation 132 and highlight thebounding box 134 when the pointer is within the bounding box 134.Further, the media device 210 may determine a location of the pointer230 based on input received at the remote control interface 218. Themedia device 210 may highlight the first bounding box 234 based ondetermining that the position of the pointer 230 is within the firstbounding box 234.

The method 500 further includes determining a hover duration indicatinghow long the pointer is within the bounding box, at 508. For example,the media device may determine that the pointer is within the boundingbox 134 for a threshold period of time. Further, the media device 210may determine that a location of the pointer 230 is within the firstbounding box 234 for a threshold period of time.

The method 500 further includes, when the hover duration satisfies athreshold modifying the overlay display to include user selectableoptions associated with the particular object, at 510. For example, themedia device 120 may display the object information or menu 138 inresponse to detecting that the position of the pointer is within thebounding box 134 for the threshold period of time. Further, the mediadevice 210 may display the object information options 238 in response todetecting that the position of the pointer 230 is within the firstbounding box 234 for the threshold period of time.

Thus, FIG. 5 describes a method of displaying an overlay based onoverlay data received separately from media content.

FIG. 6 illustrates a particular embodiment of a general computer system600 to display an overlay associated with media content. The generalcomputer system 600 may include a set of instructions that can beexecuted to cause the general computer system 600 to perform any one ormore of the methods or computer based functions disclosed herein. Thegeneral computer system 600 may operate as a standalone device or may beconnected, e.g., using a network, to other computer systems orperipheral devices. For example, the general computer system 600 mayinclude, be included within, or correspond to one or more of thecomponents of the system 100, the media device 120, the media device210, the headend 110, or a combination thereof.

In a networked deployment, the general computer system 600 may operatein the capacity of a server or as a client user computer in aserver-client user network environment, or as a peer computer system ina peer-to-peer (or distributed) network environment. The generalcomputer system 600 may also be implemented as or incorporated intovarious devices, such as a mobile device, a palmtop computer, a laptopcomputer, a desktop computer, a communications device, a wirelesstelephone, a personal computer (PC), a tablet PC, a personal digitalassistant (PDA), a set-top box, a customer premises equipment device, anendpoint device, a web appliance, or any other machine capable ofexecuting a set of instructions (sequential or otherwise) that specifyactions to be taken by that machine. In a particular embodiment, thegeneral computer system 600 may be implemented using electronic devicesthat provide video, audio, or data communication. Further, while onegeneral computer system 600 is illustrated, the term “system” shall alsobe taken to include any collection of systems or sub-systems thatindividually or jointly execute a set, or multiple sets, of instructionsto perform one or more computer functions.

As illustrated in FIG. 6, the general computer system 600 includes aprocessor 602, e.g., a central processing unit (CPU), a graphicsprocessing unit (GPU), or both. The processor 602 may be one or morecomponents (e.g., a processor) of the media device 120, the media device210, or the headend 110, or a combination thereof. Moreover, the generalcomputer system 600 may include a main memory 604 and a static memory606, which can communicate with each other via a bus 608. For example,the main memory 604 may be one or more components (e.g., a memory) ofthe media device 120, one or more components (e.g., a memory) of themedia device 210, one or more components of the headend 110, or acombination thereof. As shown, the general computer system 600 mayfurther include a video display unit 610, such as a television, liquidcrystal display (LCD), an light emitting diode (LED) display, a touchscreen display, a flat panel display, a solid state display, or a lampassembly of a projection system. Additionally, the general computersystem 600 may include an input device 612, such as a remote controldevice (e.g., a television remote or a set top box remote), keyboard,and a cursor control device 614, such as a mouse. In some embodiments,the input device 612 and the cursor control device 614 may be integratedinto a single device, such as a capacitive touch screen input device.The general computer system 600 may also include a drive unit 616, asignal generation device 618, such as a speaker or remote control, and anetwork interface device 620. The general computer system 600 may notinclude an input device (e.g., a server may not include an inputdevice).

In a particular embodiment, as depicted in FIG. 6, the drive unit 616may include a computer-readable storage device 622 in which one or moresets of overlay data and instructions 624, e.g. software, can beembedded. The computer-readable storage device 622 may be random accessmemory (RAM), read-only memory (ROM), programmable read-only memory(PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM),register(s), solid-state memory, hard disk, a removable disk, a compactdisc read-only memory (CD-ROM), other optical disk storage, magneticdisk storage, magnetic storage devices, or any other storage device thatcan be used to store program code in the form of instructions or dataand that can be accessed by a computer and/or processor. Acomputer-readable storage device is not a signal. Further, theinstructions 624 may embody one or more of the methods or logic asdescribed herein. The instructions 624 may be executable by theprocessor 602 to perform one or more functions or methods describedherein, such as the method described with reference to FIG. 6. In aparticular embodiment, the instructions 624 may reside completely, or atleast partially, within the main memory 604, the static memory 606,and/or within the processor 602 during execution by the general computersystem 600. The main memory 604 and the processor 602 also may include acomputer-readable storage device.

In an alternative embodiment, dedicated hardware implementations, suchas application specific integrated circuits, programmable logic arraysand other hardware devices, may be constructed to implement one or moreof the methods described herein. Various embodiments may broadly includea variety of electronic and computer systems. One or more embodimentsdescribed herein may implement functions using two or more specificinterconnected hardware modules or devices with related control and datasignals that can be communicated between and through the modules, or asportions of an application-specific integrated circuit (ASIC).Accordingly, the present system encompasses software, firmware, andhardware implementations.

In accordance with various embodiments of the present disclosure, themethods described herein may be implemented by software programsexecutable by a computer system, a processor, or a device, which mayinclude (forms of instructions embodied as a state machine implementedwith logic components in an ASIC or a field programmable gate array(FPGA) device.) Further, in an exemplary, non-limiting embodiment,implementations may include distributed processing, component/objectdistributed processing, and parallel processing. Alternatively, virtualcomputer system processing may be constructed to implement one or moreof the methods or functionality as described herein. It is further notedthat a computing device, such as a processor, a controller, a statemachine or other suitable device for executing instructions to performoperations or methods may perform such operations directly or indirectlyby way of one or more intermediate devices directed by the computingdevice.

The present disclosure includes a computer-readable storage device 622that stores the overlay data and instructions 624 or receives, stores,and executes the overlay data and instructions 624, so that a deviceconnected to a network 626 may generate an overlay file withoutmodifying media content or may display an overlay based on an overlayfile. For example, the computer-readable storage device 622 may includeor be included within one or more of the components of the headend 110,one or more components of the media device 120, one or more componentsof the media device 210, or a combination thereof. While thecomputer-readable storage device 622 is shown to be a single device, thecomputer-readable storage device 622 may include a single device ormultiple media devices, such as a distributed database, and/orassociated caches and servers that store one or more sets ofinstructions. The computer-readable storage device 622 is capable ofstoring a set of instructions for execution by a processor to cause acomputer system to perform any one or more of the methods or operationsdisclosed herein.

In a particular non-limiting, exemplary embodiment, thecomputer-readable storage device 622 may include a solid-state memorysuch as embedded memory (or a memory card or other package that housesone or more non-volatile read-only memories). Further, thecomputer-readable storage device 622 may be a random access memory orother volatile re-writable memory. Additionally, the computer-readablestorage device 622 may include a magneto-optical or optical device, suchas a disk or tapes or other storage device. Accordingly, the disclosureis considered to include any one or more of a computer-readable storagedevice and other equivalents and successor devices, in which data orinstructions may be stored.

The illustrations of the embodiments described herein are intended toprovide a general understanding of the structure of the variousembodiments. The illustrations are not intended to serve as a completedescription of all of the elements and features of apparatus and systemsthat utilize the structures or methods described herein. Many otherembodiments may be apparent to those of skill in the art upon reviewingthe disclosure. Other embodiments may be utilized and derived from thedisclosure, such that structural and logical substitutions and changesmay be made without departing from the scope of the disclosure. Figuresare also merely representational and may not be drawn to scale. Certainproportions thereof may be exaggerated, while others may be minimized.Accordingly, the disclosure and the figures are to be regarded asillustrative rather than restrictive.

In a particular embodiment, a method includes receiving, at a mediadevice, overlay data associated with media content. The overlay dataincludes information indicating a time and a position at which aparticular object is represented within the media content, and theoverlay data includes information associating the particular object withsupplemental information. The method further includes, during playbackof the media content, receiving user input at the media device, and,responsive to the user input, generating an overlay display based on theoverlay data, where the overlay display causes the particular object tobe highlighted in a display of the media content.

In a particular embodiment, a media device includes a processor and amemory. The memory is accessible to the processor and storesinstructions that are executable by the processor to access overlay dataassociated with media content. The overlay data includes informationindicating a time and a position at which a particular object isrepresented within the media content, and the overlay data includesinformation associating the particular object with supplementalinformation. The instructions are further executable by the processorto, during playback of the media content, receive user input and,responsive to the user input, generate an overlay display based on theoverlay data, where the overlay display causes the particular object tobe highlighted in a display of the media content.

In a particular embodiment, a computer-readable storage device storesinstructions that are executable by a processor to perform operations.The operations include receiving, at a media device, overlay dataassociated with media content. The overlay data includes informationindicating a time and a position at which a particular object isrepresented within the media content, and the overlay data includesinformation associating the particular object with supplementalinformation. The operations further include, during playback of themedia content, receiving user input at the media device, and, responsiveto the user input, generating an overlay display based on the overlaydata, where the overlay display causes the particular object to behighlighted in a display of the media content.

Although specific embodiments have been illustrated and describedherein, it should be appreciated that any subsequent arrangementdesigned to achieve the same or similar purpose may be substituted forthe specific embodiments shown. This disclosure is intended to cover anyand all subsequent adaptations or variations of various embodiments.

In one or more embodiments, a processor (which can include a controlleror circuit) has been described that performs various functions. Itshould be understood that the processor can be implemented as multipleprocessors, which can include distributed processors or parallelprocessors in a single machine or multiple machines. The processor canbe used in supporting a virtual processing environment. The virtualprocessing environment may support one or more virtual machinesrepresenting computers, servers, or other computing devices. In suchvirtual machines, components such as microprocessors and storage devicesmay be virtualized or logically represented. The processor can include astate machine, an application specific integrated circuit, and/or aprogrammable gate array (PGA) including a Field PGA. In one or moreembodiments, when a processor executes instructions to perform“operations,” this can include the processor performing the operationsdirectly and/or facilitating, directing, or cooperating with anotherdevice or component to perform the operations.

Less than all of the steps or functions described with respect to theexemplary processes or methods can also be performed in one or more ofthe exemplary embodiments. Further, the use of numerical terms todescribe a device, component, step or function, such as first, second,third, and so forth, is not intended to describe an order or functionunless expressly stated. The use of the terms first, second, third andso forth, is generally to distinguish between devices, components, stepsor functions unless expressly stated otherwise. Additionally, one ormore devices or components described with respect to the exemplaryembodiments can facilitate one or more functions, where the facilitating(e.g., facilitating access or facilitating establishing a connection)can include less than every step needed to perform the function or caninclude all of the steps needed to perform the function.

The Abstract is provided with the understanding that it will not be usedto interpret or limit the scope or meaning of the claims. In addition,in the foregoing Detailed Description, various features may be groupedtogether or described in a single embodiment for the purpose ofstreamlining the disclosure. This disclosure is not to be interpreted asreflecting an intention that the claimed embodiments require morefeatures than are expressly recited in each claim. Rather, as thefollowing claims reflect, subject matter may be directed to less thanall of the features of any of the disclosed embodiments. Thus, thefollowing claims are incorporated into the Detailed Description, witheach claim standing on its own as defining separately claimed subjectmatter.

The above-disclosed subject matter is to be considered illustrative, andnot restrictive, and the appended claims are intended to cover all suchmodifications, enhancements, and other embodiments, which fall withinthe scope of the present disclosure. Thus, to the maximum extent allowedby law, the scope of the present disclosure is to be determined by thebroadest permissible interpretation of the following claims and theirequivalents, and shall not be restricted or limited by the foregoingdetailed description.

What is claimed is:
 1. A method comprising: receiving, at a mediadevice, overlay data associated with media content, wherein the overlaydata includes information indicating a time and a position at which aparticular object is represented within the media content, and whereinthe overlay data includes information associating the particular objectwith supplemental information; during playback of the media content,receiving user input at the media device; and responsive to the userinput, generating an overlay display based on the overlay data, whereinthe overlay display causes the particular object to be highlighted in adisplay of the media content.
 2. The method of claim 1, wherein theoverlay data is received during playback of the media content.
 3. Themethod of claim 1, wherein the overlay data is received as an overlayfile that includes a first overlay entry associated with a particularobject represented in the media content and a second overlay entrycorresponding to a particular display format of the media content. 4.The method of claim 1, wherein the overlay display includes an iconcorresponding to a social network interaction, wherein selection of theicon causes an update to be sent to a social network associated with auser of the media device.
 5. The method of claim 1, wherein the userinput indicates movement of a remote control device.
 6. The method ofclaim 1, wherein the user input corresponds to a pointer control input,and further comprising determining a position in the display of apointer based on the pointer control input, wherein the particularobject is highlighted when the pointer is determined to be within abounding box defined by the overlay data, and wherein the bounding boxis specified by the overlay data.
 7. The method of claim 6, furthercomprising: determining a hover duration indicating how long the pointeris within the bounding box; and when the hover duration satisfies athreshold, modifying the overlay display to include user selectableoptions associated with the particular object.
 8. The method of claim 1,wherein the overlay display includes a description of the particularobject, a first selectable option to display additional informationrelated to the particular object, a second selectable option to conducta transaction related to the particular object, or a combinationthereof.
 9. The method of claim 1, wherein the supplemental informationincludes a communication address of an advertiser.
 10. The method ofclaim 1, wherein the media content corresponds to video on demandcontent, content stored at a memory device coupled to the media device,or a combination thereof.
 11. The method of claim 1, wherein the overlaydisplay is generated by: determining, from the overlay data, an actionidentifier associated with the particular object; sending the actionidentifier to a remote server; and receiving display information fromthe remote server, wherein the overlay display is generated based on thedisplay information.
 12. A media device comprising: a processor; and amemory accessible to the processor, the memory storing instructions thatare executable by the processor to cause the processor to: receiveoverlay data associated with media content, wherein the overlay dataincludes information indicating a time and a position at which aparticular object is represented within the media content, and whereinthe overlay data includes information associating the particular objectwith supplemental information; during playback of the media content,receive user input; and responsive to the user input, generate anoverlay display based on the overlay data, wherein the overlay displaycauses the particular object to be highlighted in a display of the mediacontent.
 13. The media device of claim 12, further comprising a wirelesssensor, wherein the user input is received, via the wireless sensor, asa signal from a remote control device, and wherein the signal indicatesmovement of the remote control device.
 14. The media device of claim 12,wherein the overlay data is received as an overlay file that includes aplurality of overlay entries, each overlay entry of the plurality ofoverlay entries associated with a corresponding object represented inthe media content, and wherein the instructions further cause theprocessor to store the overlay file in the memory.
 15. The media deviceof claim 14, wherein each overlay entry of the plurality of overlayentries includes information describing the corresponding object,information defining a bounding box associated with the correspondingobject, information defining a time in the media content at which thecorresponding object is represented, a pointer to additional informationrelated to the corresponding object, or a combination thereof.
 16. Themedia device of claim 14, wherein the overlay file includes overlayentries corresponding to a plurality of distinct versions of the mediacontent, wherein the plurality of distinct versions of the media contenthave different display formats.
 17. The media device of claim 12,wherein the overlay data is received after playback of the media contentbegins.
 18. The media device of claim 12, wherein the instructionsfurther cause the processor to: while the overlay display is presentedat a display device, automatically pause playback of the media contentand store, at the memory, media data associated with portions of themedia content that have not yet been provided to the display device; andwhen presentation of the overlay display ceases, automatically resumeplayback of the media content using the media data stored at the memory.19. A computer-readable storage device storing instructions that areexecutable by a processor to cause the processor to perform operationscomprising: receiving, at a media device, overlay data associated withmedia content, wherein the overlay data includes information indicatinga time and a position at which a particular object is represented withinthe media content, and wherein the overlay data includes informationassociating the particular object with supplemental information; duringplayback of the media content, receiving user input at the media device;and responsive to the user input, generating an overlay display based onthe overlay data, wherein the overlay display causes the particularobject to be highlighted in a display of the media content.
 20. Thecomputer-readable storage device of claim 19, wherein the overlaydisplay includes a description of the particular object, a firstselectable option to display additional information related to theparticular object, a second selectable option to conduct a transactionrelated to the particular object, or a combination thereof.